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Abstract 

We study the performance of the adaptive construction 
scheme for a Bayesian inference on the Quadratic GARCH 
model which introduces the asymmetry in time series dy- 
namics. In the adaptive construction scheme a proposal 
density in the Metropolis-Hastings algorithm is constructed 
adoptively by changing the parameters of the density to fit 
the posterior density. Using artificial QGARCH data we 
infer the QGARCH parameters by applying the adaptive 
construction scheme to the Bayesian inference of QGARCH 
model. We find that the adaptive construction scheme sam- 
ples QGARCH parameters effectively, i.e. correlations be- 
tween the sampled data are very small. We conclude that 
the adaptive construction scheme is an efficient method to 
the Bayesian estimation of the QGARCH model. 

1. Introduction 

A notable feature of financial time series is that volatility 
of asset returns varies in time and high (low) volatility 
persists, which is called volatility clustering. Moreover the 
return distributions show fat-tailed distributions. These em- 
pirical properties are called stylized facts. There also exist 
further stylized facts seen in financial markets|fl~). 

A primary importance in empirical finance is to make 
models which mimic the properties of the volatility and then 
to forecast future volatility. The most successful model is the 
Generalized Autoregressive Conditional Heteroscedasticity 
(GARCH) model by Engle0 and BollerslevfJ], which can 
capture the property of volatility clustering and show the 
fat-tailed distribution. 

In the original GARCH model, the process generates 
symmetric time series. For stock markets, however, stock 
returns may show significant negative skewness in volatility 
dynamics. In order to incorporate the skewness into the 
model, some modified models have been proposed^, 0, 
@, 0. Among them we focus on the Quadratic GARCH 
(QGARCH) model|6|, |7| which includes an additional term 
that can capture the property of the skewness. 

A preferred algorithm to infer GARCH model parameters 
is the Maximum Likelihood (ML) method which estimates 
the parameters by maximaizing the corresponding likelihood 
function of the GARCH model. In this algorithm, however, 



there is a practical difficulty in the maximization procedure 
when the output results are sensitive to starting values. 

By the recent computer development the Bayesian infer- 
ence implemeneted by Markov Chain Monte Carlo (MCMC) 
methods, which is an alternative approach to estimate 
GARCH parameters, has become popular. There exists a 
variety of methods proposed to implement the MCMC 
scheme|8|-| 13 1. In a recent survey |fl~2] it is shown that 
Acceptance-Rejection/Metropolis-Hastings (AR/MH) algo- 
rithm works better than other algorithms. In the AR/MH 
algorithm the proposal density is assumed to be a multivari- 
ate Student's t-distribution and the parameters to specify the 
distribution are estimated by the ML technique. Recently 
an alternative method to estimate those parameters without 
relying on the ML technique was proposed lfl4l . In this 
method the parameters are determined by using the data 
generated by an MCMC method and updated adaptively 
during the MCMC simulation. We call this method "adaptive 
construction scheme". 

The adaptive construction scheme was tested for artificial 
GARCH data and it is shown that the adaptive construction 
scheme can significantly reduce the correlation between 
sampled data lfl4l . In this study we apply the adaptive 
construction scheme to the QGARCH model. The orignal 
GARCH model has 3 model parameters. On other hand the 
QGARCH model has 4 model parameters. We study the 
efficiency of the adaptive construction scheme applied to 
the QGARCH model and examine whether the efficiency is 
still high enough for such a model with many parameters. 

2. QGARCH Model 

The QGARCH modelH, Q which we employ here is 
written as 



°t = u + IVt-i + ayt-i 



(1) 



(2) 



where e t is an independent normal error ~ N(0, 1) and 
yt are observations. Here a, j3, 7 and lo are the parameters 
to be estimated in the Bayesian inference. The QGARCH 
process differs from the GARCH one by the term "fyt-i 
which introduces asymmetry. 



3. Bayesian inference 

From the Bayes' theorem the posterior density n(8\y) 
with n observations y = (j/i , 2/2 » - - • j Vn) is given by 

n(6\y) <x L(y\O)n(0), (3) 

where L(y\0) is the likelihood function. tt(9) is the prior 
density for 9. The functional form of tt(9) is not known 
a priori. Here we assume that the prior density w(9) is 
constant. 

For the QGARCH model the likelihood function is given 

L(y|#)=nr =1 ^=L=exp(-^), (4) 

"t 



where 9 = (u, a, (3, 7) stands for the QGARCH parameters. 

Using it(6\y) the QGARCH parameters are inferred as 
the expectation values given by 

(6) = ± J 9n(9\y)d9, (5) 

where Z — J n(9\y)d9 is a normalization constant irrelevant 
to MCMC estimations. 

The MCMC technique gives a method to estimate eq.© 
numerically. The basic procedure of the MCMC method 
is as follows. First we sample 9 drawn from a probability 
distribution ir(9\y). Sampling is done by a technique which 
produces a Markov chain. After sampling some data, we 
evaluate the expectation value as an average value over the 
sampled data 0W, 

»=i 

where k is the number of the sampled data. The statistical 
error for k independent data is proportional to In 
general, however, the data generated by the MCMC method 
are correlated. As a result the statistical error will be 
proportional to \J~^- where t is the autocorrelation time 
between the sampled data. The autocorrelation time depends 
on the MCMC method we employ. Thus it is desirable to 
choose a MCMC method which can generate data with a 
small t. 

3.1. Metropolis-Hastings algorithm 



The MH algorithm! 16] is a generalized version of the 
Metropolis algorithm! 15 1. Let us consider to generate data 
x from a probability distribution P(x). The MH algorithm 
consists of the following steps. First starting from x, we pro- 
pose a candidate x' which is drawn from a certain probability 
distribution g(x'\x) which we call proposal density. Then we 
accept the candidate x' with a probability Pmh{x, x') as the 
next value of the Markov chain: 

P(x') g(x\x' 



Pmh{x,x') = min 



1, 



P{x) g{x'\x) 



Then we 



If x' is rejected we keep the previous value x. 
repeat these steps. 

4. Adaptive construction scheme 



By choosing an adequate proposal density for the MH 
algorithm one may reduce the correlation between the 
sampled data. The posterior density of GARCH parameters 
often resembles to a Gaussian-like shape. Thus one may 
choose a density similar to a Gaussian distribution as the 
proposal density. Such attempts have been done by Mit- 
sui, Watanabe[ 1 1 1 and Asai lfT2l . They used a multivariate 
Student's t-distribution in order to cover the tails of the 
posterior density and determined the parameters to specify 
the distribution by using the ML technique. Here we also 
use a multivariate Student's t-distribution but determine the 
parameters through MCMC simulations. 

The (p-dimensional) multivariate Student's t-distribution 
is given by 

T{{v + p)/2)/T{v/2) 



M = 



detE 1 /2( i , 7r )p/2 
(9 - M)*S- 



l (9- M) 



-, -{v+p)/2 



,(8) 



where 9 and M are column vectors, 
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(9) 



and Mi = E(9i). S is the co variance matrix defined as 
E[{9 - M)(9 - Mf]. 



u-2 



(10) 



(7) 



v is a parameter to tune the shape of Student's t-distribution. 
When v — > 00 the Student's t-distribution goes to a Gaussian 
distribution. At small v Student's t-distribution has a fat-tail. 
We also define the matrix V by V = E[(9 - M)(9 - Mf] 
for later use. 

There are 4 parameters in the QGARCH model. Thus 
p = 4, 9 = (01,02,03,04) = («, A^, 7) and, E and V 
are 4x4 matrices. The unknown parameters in M and E 
are determined by using the data obtained from MCMC 
simulations. First we make a short run by the Metropolis 
algorithm and accumulate some data. Then we estimate M 
and E. Note that there is no need to estimate M and E 
accurately. Second we perform a MH simulation with the 
proposal density of eq.® with the estimated M and E. 
After accumulating more data, we recalculate M and E, 
and update M and E of eq.®. By doing this, we adaptively 
change the shape of eq.® to fit the posterior density. We 
call eq.© with the estimated M and E "adaptive proposal 
density". 
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Figure 1 . The times series generated by the QGARCH 
process with a = 0.07, f3 = 0.8, 7 = -0.05 and u = 0.1. 



Figure 3. Monte Carlo history of a from the adaptive 
construction scheme. 
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Figure 2. Histograms of a from the adaptive construe- Figure 4. Monte Carlo history of a from the Metropolis 
tion scheme and the Metropolis algorithm. algorithm. 



5. Numerical results 

We examine the adaptive construction scheme by using 
artificial QGARCH data generated with known parameters. 
The QGARCH parameters are set to a = 0.07, (3 = 0.8, 
7 = -0.05 and uj = 0.1. We have generated 2000 data by 
the QGARCH process with these parameters as displayed in 
Fig.l. 

The adaptive construction scheme is implemented as 
follows. First we start a run by the Metropolis algorithm. The 
first 3000 data are discarded as burn-in process or in other 
words thermalization. Then we accumulate 1000 data for M 
and £ estimations. The estimated M and £ are substituted 
to g{9). In this study we take v = 10. We re-start a run 
by the MH algorithm with g{9). Every 1000 updates we re- 
calculate M and E and update g{9). We accumulate 100000 
data for analysis. 

For comparison we also use a standard Metropolis al- 
gorithm to infer the GARCH parameters and accumulate 
100000 data for analysis. 

The results of the parameters inferred by the adaptive con- 



struction scheme and Metropolis algorithm are summarized 
in Table 1. 

Fig. 2 compares the histogram of the sampled data a by 
the adaptive construction scheme with that by the Metropolis 
algorithm. The histograms from the two MCMC techniques 
seem to coincide each others. However the property of the 
sampled data is very different, which will be analyzed in the 
followings. 

Fig. 3-4 show Monte Carlo time histories from the 
adaptive construction scheme and Metropolis algorithm. It 
is clearly seen that the data sampled by the Metropolis 
algorithm are substantially correlated. The similar behavior 
is also seen for the sampled data for other parameters. 

The correlations between the data can be measured by 
the autocorrelation function (ACF). The ACF of certain 
successive data #W is defined by 

mc FM =*^-"°' (11) 

where (9) and (jg are the average value and the variance of 
9 respectively. 



Table 1 . Results of QGARCH parameters. SD and SE 
stand for standard deviation and statistical error 
respectively. 





a 


P 


UJ 


7 


true 


0.07 


0.8 


0.1 


-0.05 


Adaptive 


0.07143 


0.7905 


0.1054 


-0.04643 


SD 


0.018 


0.056 


0.035 


0.019 


SE 


0.00012 


0.0005 


0.0004 


0.00010 


2r 


4.1 ± 1.3 


10 ±5.0 


11 ± 5.1 


3.0 ±0.4 


Metropolis 


0.0704 


0.7943 


0.1032 


-0.0465 


SD 


0.018 


0.053 


0.033 


0.019 


SE 


0.0011 


0.0052 


0.0032 


0.0004 


2t 


340 ± 100 


840 ± 280 


820 ± 290 


54 ±7 




Figure 5. Autocorrelation function of a sampled by the 
adaptive construction scheme. 



Fig. 5-6 show the ACF of a sampled from the adaptive 
construction scheme and the Metropolis algorithm. The ACF 
of the adaptive construction scheme decreases quickly as 
Monte Carlo time t increases. On the other hand the ACF 
of the Metropolis algorithm decreases very slowly which 
indicates that the correlation between the sampled data is 
very large. 

The autocorrelation time (ACT) r is calculated by 



1 oo 

- + J2acf( 1 ). 



(12) 



Results of r are summarized in Table 1. We find that the 
ACT from the adaptive construction scheme have much 
smaller r than those from the Metropolis simulations. For 
instance r of a parameter from the adaptive construction 
scheme is decreased by a factor of 90 compared to that 
from the Metropolis algorithm. These results prove that the 
adaptive construction scheme is an efficient algorithm for 
sampling de-correlated data. The differences in r also ex- 
plain that the statistical errors from the adaptive construction 
scheme are much smaller than those from the Metropolis 
simulations. 

Fig. 7-8 show the convergence property of the covariance 
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Figure 6. Autocorrelation function of a sampled by the 
Metropolis algorithm. 
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Figure 7. The diagonal elements of V as a function of 
the data size. 



matrix V. All the elements of V seem to converge to certain 
values as the simulations are proceeded. 

Fig. 9 shows values of the acceptance at the MH algorithm 
with the adaptive proposal density of eq.®. Each acceptance 
is calculated every 1000 updates and the calculation of the 
acceptance is based on the latest 1000 data. At the first stage 
of the simulation the acceptance is low. This is because 
M and £ have not yet been calculated accurately as we 
see in Fig. 7-8. However the acceptances increase quickly 
as the simulations are proceeded and reaches plateaus of 
about 70%. This acceptance is reasonably high for the MH 
algorithm. 

6. Conclusions 

We have performed the Bayesian inference of the 
QGARCH model by applying the adaptive construction 
scheme to the MH algorithm. The adaptive construction 
scheme, which does not use the ML method, is found 
to be very efficient in the sense that the autocorrelation 
times of the sampled data are very small. Thus the adaptive 
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Figure 8. Some off-diagonal elements of V as a 
function of the data size. Other off-diagonal elements 
show the similar convergence behavior. 
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Figure 9. Acceptance at MH step with the adaptive 
proposal density. 



construction scheme serves as an efficient MCMC technique 
for the Bayesian inference of the QGARCH model. The 
adaptive construction scheme is not limited to the Bayesian 
inference of the QGARCH or GARCH models and can be 
applied for other GARCH-type models. 

Although we have updated the parameters of the Student's 
t-distribution adaptively using the sampled data during the 
simlation, we may take a strategy that we stop to update the 
parameters at some point. As seen in fig. 9, the acceptance 
quickly reaches a plateau of about 70% and after that the 
adaptive parameter update does not improve the acceptance. 
Thus we may stop to update the parameters and use the 
fixed proposal density for the MH step after the acceptance 
reaches the plateau. 
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